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Scientific  Progress 

During  2012-2013  we  developed  Wick-Mallivian  calculus  for  non-adapted  systems  of  Stochastic  PDE’s. 

In  2013-2014  I  have  been  working  in  three  areas: 

(a)  Stochastic  partial  differential  equation 

(b)  Distribution-free  Malliavian  calculus 

(c)  Numerical  methods  for  stochastic  PDEs 

In  area  (a)  I  have  completed  the  main  part  of  the  monograph  “Stochastic  Partial  Differential  Equations”  (to  be  published  by 
Springer).  In  area  (b)  I  have  developed  (in  collaboration  with  Prof.  Mikulevicius)  a  new  version  of  Malliavian  calculus.  The  main 
advantage  of  this  new  methodology  is  that  it  is  universal.  It  applies  to  all  types  of  randomness.  In  contrast,  all  previous  results 
on  this  subject  were  limited  to  Gaussian  or  Levy  randomness.  In  area  (c)  I  have  been  concentrating  on  fast  computational 
methodologies  for  numerical  approximations  of  various  types  of  stochastic  PDEs. 

In  2014-2015  I  have  been  working  on  the  overlap  of  three  important  areas  of  applied  mathematics:  stochastic  partial  differential 
equations,  Malliavian  calculus,  and  numerical  approximations  of  stochastic  PDE’s  including: 

(1 )  Numerical  methods  in  stochastic  PDEs,  in  particular,  convergence  rate  for  finite  element  approximations  for  semi-linear 
systems; 

(2)  Applications  of  Malliavian  calculus  to  analysis  and  approximations  of  adapted  and  non-adapted  versions  of  stochastic 
PDEs. 

(3)  Development  of  distribution  free  approach  to  stochastic  PDEs.  The  results  obtained  in  this  area  turned  out  to  be  universal 
for  all  linear  stochastic  PDEs 

(4)  In  addition,  I  have  completed  (in  collaboration  with  Prof.  S.  Lototsy)  the  text  book  “Stochastic  Partial  Differential  Equations” 
to  be  published  by  Springer. 


The  developed  theory  and  related  numerical  methods  contribute  to  accelerated  analysis  and  testing  of  complex  high 
dimensional  systems. 


Technology  Transfer 


ARO  Grant  #61840-MA 


Nonlinear  Stochastic  PDEs:  Analysis  and  Approximations 
(2012-2015) 


Recent  Achievements.  So  far  the  theory  and  numerical  methodology  for  solving  stochastic  PDEs 
or  ODEs  have  dealt  almost  exclusively  with  Gaussian  or  Poisson/L'cvy  randomness.  However, 
in  various  applications,  practitioners  are  often  forced  to  deal  with  a  variety  of  types  of  random 
perturbations 

Subject  of  Research:  The  main  subject  of  the  research  supported  by  the  Grant  is  a  universal 
approach  to  solving  linear  and  nonlinear  stochastic  PDEs  driven  by  various  types  of  random 
perturbations  and  their  mixtures.  More  specifically,  our  research  (related  to  the  Grant) 
concentrates  on  stochastic  PDEs  with  polynomial  nonlinearity  (e.g.  stochastic  Navier-Stokes, 
Burgers,  etc.)  driven  by  arbitrary  noise. 

Importance  of  the  Subject:  Stochastic  partial  differential  equations  (SPDEs)  is  an 
interdisciplinary  area  at  the  overlap  of  stochastic  processes  (random  fields)  and  partial 
differential  equations.  Stochastic  hydrodynamics,  quantum  physics,  interacting  particle  systems, 
nonlinear  filtering,  and  theory  of  super-processes  have  influenced  the  development  of  SPDEs  at 
the  overlap  of  stochastic  processes  (random  fields)  and  partial  differential  equations.  It  is 
probably  safe  to  say  that  in  the  last  three  decades  SPDEs  has  been  one  of  the  most  dynamic  areas 
of  stochastic  analysis. 

Mathematical  objective:  Development  of  the  mathematically  rigorous  and  numerically  efficient 
methodology  for  solving  complex  stochastic  partial  differential  equations  of  interest  for  ARO. 

Task:  Development  of  the  universal  approach  for  mathematically  rigorous  and  numerically 
efficient  methodology  for  solving  complex  stochastic  partial  differential  equations  of  interest  for 
ARO. 

This  task  was  solved  in  the  paper  “On  distribution-free  Skorokhod-Malliavin  Calculus”  in  the 
journal  “Stochastic  and  Partial  Differential  Equations.  Analysis  and  Computations”  Vol.4, 
Number  2,  June  2016,  Springer. 

The  fundamental  fact  proven  in  this  paper  is  that  for  linear  SPDEs  with  ANY  reasonable 
randomness,  the  solution  can  be  represented  explicitly  via  the  lower  triangular  set  of 


DETERMINISTIC  PDEs  which  could  be  solved  sequentially.  Moreover,  this  deterministic 
system  of  SPDEs  could  be  solved  sequentially. 


Development  of  new  powerful  methodologies  for  solving  SPDE.  A  good  example  of  such 
methodology  is  Polynomial  Stochastic  Chaos  Expansion.  This  new  technique  could  be  viewed  as 
stochastic  Fourier  expansion.  It  separates  randomness  noise  in  the  system  from  the  deterministic 
propagator  (typically,  a  deterministic  PDE) 

In  2012-2013  I  was  working  in  the  following  areas: 

(a)  Stochastic  analysis  and  numerical  methods 

(b)  SPDEs 

(c)  Homogenization  and  uncertainty  quantification  for  turbulent  flows. 

In  particular,  I  have  been  actively  working  on  a  numerical  approximations  of  SPDEs, 
Wick-Malliavian  approximations,  stochastic  homogenization,  theoretical  approximation 
of  polynomial  nonlinearities  in  SPDEs. 

Accomplishments:  Developed  Wick-Malliavian  calculus  for  non-adapted  systems  of  SPDEs. 

In  2013-2014  I  have  been  working  in  three  areas: 

(a)  Stochastic  partial  differential  equations 

(b)  Distribution-free  Malliavin  calculus 

(c)  Numerical  methods  for  stochastic  PDEs: 

Accomplishments : 

1 .  In  area  (a)  I  have  completed  the  monograph  “ Stochastic  Partial  Differential  Equations ”  (to  be 
published  by  Springer  in  2017) 

2.  In  area  (b)  I  have  developed  (in  collaboration  with  Prof.  Mikulevicius)  a  new  version  of 
Malliavin  calculus.  The  main  advantage  of  this  new  methodology  is  that  it  is  universal.  It  applies 
to  all  types  of  randomness.  In  contrast,  all  previous  results  on  this  subject  were  limited  to 
Gaussian  or  Levy  randomness. 

3.  In  area  (c)  I  have  been  concentrating  on  fast  computational  methodologies  for  numerical 
approximations  of  various  types  of  stochastic  PDEs. 


In  2014-2015 
Accomplishments 


Developed:  A  Wiener  Chaos  approach  to  analysis  of  nonlinear  partial  differential  equations  in 
random  environment. 


Introduced:  A  number  of  effective  approaches  to  numerical  analysis  of  several  important  types  of 
stochastic  PDEs. 


Proposed  and  implemented:  Several  effective  classes  of  numerical  algorithms  for  practical 
implementation  of  the  related  algorithms. 

The  main  problem  in  analysis  and  computations  of  solutions  for  SPDEs  is  that  the  solutions  vary 
depending  on  chance.  The  randomness  might  appear  in  initial  and  boundary  conditions,  forcing, 
variability  of  coefficients.  This  results  in  formidable  difficulties  in  solving  SPDEs  (numerically 
as  well  as  theoretically). 

To  deal  with  these  (quite  formidable  difficulties)  in  my  research  supported  by  the  ARO  (Grant 
61840-MA)  I  have  developed  a  completely  new  and  very  efficient  methodology  for  treating 
SPDEs  .  This  methodology  is  referred  now  as  Polynomial  (or  Wiener)  Chaos.  Roughly  speaking 
it  is  a  "stochastic  Fourier  series  expansion"  which  separates  random  and  deterministic. 

The  deterministic  part  (finding  the  deterministic  coefficients)  can  be  solved  offline.  Combining 
this  coefficients  with  the  randomness  involved  in  the  equation  becomes  almost  trivial  and 
amazingly  simple  from  the  computational  as  well  as  theoretical  points  of  view. 

In  fact,  the  aforementioned  methodology  allows  to  compute  all  statistical  moments  of  the 
solution  (mean,  variance,  and  higher  statistical  moments  of  the  solution  off  line)  EXPLICITLY 
and  do  not  worry  about  randomness: 

NO  NEED  FOR  MONTE  CARLO ! ! ! ! 

Overall  Summary 

Significance: 

SPDEs  is  a  new  and  fast  developing  area.  However,  practically,  all  research  on  stochastic  PDEs 
was  limited  to  SPDEs  driven  by  Wiener  (Gaussian  random  variables)  process  or  Levi 
(exponential/  Poisson  random  variables)  process. 

These  limitations  are  troublesome,  because  there  are  many  other  important  types  of 
randomness,  including:  uniform,  gamma,  beta,  binomial  hypergeometric,  and  other  distributions. 

To  overcome  this  serious  shortcoming  we  introduced  and  investigated  an  extension  of  our 
previous  work  to  the  settings  with  arbitrary  randomness. 

Methodology  used 

Our  main  assumption  is  very  simple  and  at  the  same  time  very  general:  we  will  consider 
stochastic  PDEs  perturbed  by  a  sequence  of  arbitrary  uncorrelated  random  variables  (^1,^,2,— )• 
The  above  setting  constitute  the  so  called  "distribution  free"  paradigm.  Our  task  is  to  develop  a 
universal  stochastic  analysis  which  includes  all  types  of  randomness  mentioned  above  and 
beyond. 

This  methodology  and  related  numerical  algorithms  were  implemented  for  solving  the  main 
types  of  stochastic  PDEs,  including  stochastic  Boussinesq  equation.  Burgers  equation,  Navier- 
Stokes  equation,  Eiler  equation,  Cahn-Hillard  equation,  Camassa-Hillard  equation,  etc 

The  technical  approach: 

The  technical  approach  of  this  proposal  was  four-fold  : 


a)  Introduction  of  stochastic  polynomial  chaos  (SPC)  approach  for  various  classes  of 
randomness; 

b)  Development  of  SPC-type  approximations  for  solving  fundamental  nonlinear  and  linear 
SPDEs. 

d)  Building  numerical  methods  and  algorithms  based  on  the  SPC  approach. 

e)  Construction  and  implementation  of  "distribution  free/independent")  SPC. 

The  SPC  approach  is  essentially  a  stochastic  nonlinear  "Fourier  series"  approach. 


Major  Result. 

The  following  result  (established  in  our  research  supported  by  ARO  is  a  distribution  free  (DF) 
version  of  the  celebrated  Cameron-Martin  Theorem.  It  holds  under  very  general  assumptions: 

Major  Theorem  :There  exists  an  explicit  orthogonal  system  ( Rn)  where 

n=(n1;  n2, ... )  so  that  for  any  random  function  f(f  1;  %2,  ■  ■ ), 

Elf(^2,..)l2=£n,o  fnRn  and  fn=E[fnRny n! 


where  n  =  {n1)n2> ...)  and  \n\  =  <  oo,  £ ifn 2  n!=E[/2]  <  oo 


How  one  solves  stochastic  PDEs  in  the  distribution  free  setting? 

Consider  a  general  stationary/”elliptic”  SPDE 

Au+(Mu)R  =  g  (El) 

Then  a  solution  to  this  equation  is  given  by  £niin,  where 

un  solve  the  following  lower  —  triangular  system  Ait0  =  Eg  if  lnl=0 

Altn  +  Xn>l  ^n^ti-£n(0  9n  if  |n|  0.  (BE) 

Then  solution  to  system  (El)  is  given  by 

u=Z!n>0  nn^n- 

The  system  (BL)  is  often  referred  to  as  the  propagator.  The  term  “propagator”  emphasizes  that 
this  deterministic  system  propagates  randomness  involved  in  the  related  SPDE.  Similarly  to 
system  (El)  one  can  solve  non-stationary  ’’parabolic”  SPDE 


v(t)=Av+(Mv)  (E2) 


CONCLUSION: 


The  developed  theory  and  related  numerical  methods  contribute  to  accelerated  analysis  and 
testing  of  complex  high  dimensional  systems. 
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Stochastic  Navier  Stokes  Equation 


Stochastic  Navier  Stokes  (SNS):  a  Navier  Stokes  Equation  with 
randomness  generated  by  any  or  all  of  the  following  random  sources: 
forcing,  initial  conditions,  boundary,  etc. 

Example:  Evolution  of  NS  with  random  initial  condition  forcing: 


!dtu  =  vA u  -  ( u ,  V)u  +  /(£,  x)  -  Vp(t,  x ) 
+g(t,  x)W(t),x  e  D,div  u(t,x)  =  0 

u(0,x)  =  Uq  (x,2(M)),U \gD  =  <p(x,i(M)), 


Where  W(t)=2/c>i  mM^k  is  a  Brownian  motion , 

2(M)=(^1,  ■■■  1>m)>  M  <  oo,  is  a  Gaussian  vector,  f(t,  x)  and 

g(t,  x)  are  appropriate  deterministic  functions. 

Randomness  generates  uncertainty.  How  to  quantify? 
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Wick-Mallivian  Expansion 


mWick  product  is  defined  by  hn  0  hx  =  hn+1.Malliavin  derivative 
(inverse  to  Wick  product)  is  defined  by  D hn  =  hn_ ±. 

mAn  important  formula :  if  f  =  fff)  and  g=g(^)  have  second  moment,  then 

fg=SP>o^(Op/ODp5)  (2) 

Where  0  is  the  so  called  Wick  product  and  D  is  the  Malliavin  derivative 
(Mikulevicius  and  Rozovsky.,  Probability  Theory  and  Random  Fields,  2011) 

Formula  ( 2 ]  implies  that  the  nonlinear  terms  in  SNF 
uVu  ~  ( Dpu  0  DvVu) 

p— u  p\  p\ 

is  a  reasonable  approximation  to  the  nonlinear  term  in  SNS. 

■  Fact:  The  lower  triangular  approximation  is  equivalent  to  "zero  order" 
approximation  uVu  ^  u  0  Vu 
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Computational  Mesh 


Boundary  conditions 


x 


Computational  mesh 
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Standard  Deviation  of  the  Streamwise  Velosity 
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Convergence  of  Wick-Malliavin 
Approximations 
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FUTURE  RESEARCH 

(in  collaboration  with  Dr.  Chi-Wang  Shu) 


The  theory  and  applications  of  stochastic  analysis  and  stochastic  PDEs  is  well 
developed  for  Gaussian  and  Poisson  processes.  It  appears  that  these  results 
can  be  extended  to  a  large  class  of  stochastic  systems  perturbed  by  arbitrary 
noise.  In  fact,  P.  A.  Meyer,  one  of  the  founders  of  stochastic  analysis,  noted: 
"The  first  and  very  important  point  is  that,  in  the  construction  of  multiple 
integrals,  the  Gaussian  character  of  the  process  never  appears" 

With  this  in  mind,  we  propose  a  reasonably  general  approach  to  analysis  and 
computations  of  stochastic  PDEs  driven  by  "arbitrary"  noise.  The  above 
setting  is  often  called  "distribution  free"  paradigm.  Our  task  is  to  develop  a 
version  of  Malliavin-Skorohod  calculus  in  the  distribution  free  setting  and  to 
apply  this  methodology  to  analysis  and  computations  of  linear  and  non¬ 
linear  stochastic  PDEs. 
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